Exact Enumeration of Ground States in the Sherrington-Kirkpatrick Spin Glass 
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Using the discrete ±J bond distribution for the Sherrington-Kirkpatrick spin glass, aU ground 
states for the entire ensemble of the bond disorder are enumerated. Although the combinatorial 
complexity of the enumeration severely restricts attainable system sizes, here A'' < 9, some remark- 
ably intricate patterns found in previous studies already emerge. The analysis of the exact ground 
state frequencies suggests a direct construction of their probability density function. Against expec- 
tations, the result suggests that its highly skewed appearance for finite N evolves logarithmically 
slow towards a Gaussian distribution. 

PACS numbers: 75.10.Nr , 05.50.+q , 02.60.Pn 
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The Sherrington-Kirkpatrick (SK) model of glassy 
behavior in magnetic materials has provided a concep- 
tual framework for the effect of disorder and frustration 
that are observed in systems ranging from materials 
to combinatorial optimization and learning 3]. It's con- 
ceptual simplicity is expressed through the Hamiltonian 



H = 



N 



i<j 



(1) 



in which all pairs of binary Ising spin- variables ct^ = ±1 
are mutually connected through a bond matrix J^.j, 
which is symmetric and whose entries are random vari- 
ables drawn from a distribution P( J) of zero mean and 
unit variance. We note that this Hamiltonian possesses 
a local "gauge" -invariance under the transformation of 



-ffi and Ji 



(2) 



at any site i and the bonds to all its adjacent sites j 

The SK model has reached significant prominence be- 
cause, despite of its apparent simplicity, its solution 
proved surprisingly difficult, revealing an amazing degree 
of complexity in its structure 3]. While it is solvable in 
principle, many of its features have not been derived yet. 
One such feature concerns the probability density func- 
tion (PDF) of its ground state energies. Being an ex- 
treme element of the energy spectrum, the distribution 
of eo is not necessarily normal but instead may follow 
a highly skewed "extreme- value statistics" as can be de- 
rived for the Random Energy Model |^ . If the energies 
within that spectrum are uncorrelated, it can be shown 
that the PDF for eo is among one of only a few univer- 
sal functions. This extreme- value statistics of the ground 
states has been pointed out in Ref. 5] and has received 
considerable attention recently |E0lE0- For instance, 
if the sum for H in Eq. were over a large number of 
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independent terms, H would be Gaussian distributed. In 
such a spectrum, the probability of finding H — oo de- 
cays faster than any power, and ground states eo should 
be distributed according to a Gumbel PDF, |^ 



g„iix) (X exp{rn(a; - e^)} 



(3) 



with TO = 1, here generalized to the case where to refers 
to the TO-th lowest extreme value 

In a spin glass the individual terms in Eq. ^ are 
not independent variables and deviations from any uni- 
versal behavior may be expected. In particular, these 
deviations should become strongest when all spin vari- 
ables are mutually interconnected such as here in the 
SK model, but may be less so for sparse graphs, such as 
low-dimensional lattices. (Although it should be noted 
that sparsely connected systems seem to have a Gaus- 
sian PDF, see Ref. provably so finite-dimensional lat- 
tices Indeed, in mean-field models Refs. 
find numerically a highly skewed PDF for eo which does 
not fit to the Gumbel distribution in Eq. for an m = 1- 
lowest value. In Fig. we plot the rescaled PDF of 
ground state energies in the SK obtained in Ref. @ for 
± J bonds on systems of size N = 127 — 511 with the 
extremal optimization (EO) heuristic The result re- 
sembles that of Ref. 7| to a surprising degree. In fact, a 
naive fit of Eq. O for variable m to the SK-data, as sug- 
gested by Ref. f^, yields virtually identical results, with 

TOWS. 

In this Communication, we derive the PDF in Eq. © 
analytically, motivated from the study of exact enumer- 
ations of ground states in the SK for small N. Wc find 
an A'^-dependent parameter 



In(A^) 



(4) 
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to leading order. As to grows with A^, the gm{x) ulti- 
mately develops a (symmetric) Gaussian form. Yet, m 
grows sufficiently weakly to justify the the highly skewed 
appearance of the PDF observed numerically over a wide 
range of sizes A^, see Fig. 

Unlike for the Gaussian bond distribution, discrete 
bonds allow a complete enumeration of the ground-state 
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FIG. 1: Plot of the rescaled probability density function of 
ground state energies using ±J bonds. Shown are the nu- 
merical data for the SK model obtained with the extremal 
optimization (EO) heuristic and their fit by Eq. (|3J with 
m — 5.4, properly rescaled, from Ref. :8], and the exact results 
for N = 9 based on Tab. |I] Remarkably, there is very little 
variation between the exact data at A'^ = 9 and the numerical 
data obtained for N = 127 ~ 511. 



TABLE I: Count ns(A^) of the number of instances of size A'' 
having B violated bonds in the ground state. Rescaled as a 
PDF, ns(9) is plotted in Fig.[T] 
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PDF for each possible bond structure at small system 
sizes N . The motivation for such a study is provided by 
the hope to discern certain patterns in the solutions that 
may be extrapolated to the large- A'' limit. Looking at 
the PDF as a whole, we find at small A^ a highly skewed 
function. In Fig. ^ we show that the exact result for 
iV = 9 compares quite well with the numerical sampling 
at larger A^, and with the Gumbel fit. A detailed analysis 
of the results at A^ < 9 suggests a direct construction of 
the PDF assuming only local gauge symmetry. 

For the ±J bond distribution, complete enumeration 
entails a generation of all possible symmetric NxN bond 
matrices Jij, filled with all combinations of J^.j = +J or 
—J. (Diagonal elements, corresponding to self-coupling 
terms, are zero.) For each instance, we then determine 
the ground state. Clearly, the combinatorial effort in- 
volved in merely generating all instances becomes pro- 
hibitive already for small N, restricting us here to iV < 9. 
For = 9 the program runs for about 5h on a 2GIIz com- 
puter. Larger N within reasonable CPU-time probably 
could have been reached with a more elaborate algorithm 
that recursively constructs from N — 1 to N only dis- 
tinct instances by adding a new vertex with all possible 
bond combinations, and determines their ground state 
and their weight. We merely exploit the fact that we can 
always use Eq. (j^J to gauge-transform to have one spin in 
any instance to, say, only possess J — +1 bonds, leaving 
us with {N-l){N-2)/2 variable bonds or 2(^-i)(^-2)/2 
instances at each A^. 

In Tab. m we list the count nsiN) for instances with 
B violated bonds, starting from the ferromagnetic (FM) 
instance with _B = to the totally anti-ferromagnetic 



(AFM) instance with 



Rat -1)74, 

\n{N-2)/^, 



N odd, 
A^ even. 



(5) 



For instance, after accounting for the gauge symmetry, 
no{N) — 1 corresponds to the one instance with perfect 
ferromagnetic order, while on the bottom of each column 
we find the one perfect anti-ferromagnet with the largest 
number of violated bonds -Bmax, which arises because the 
energy of the AFM is minimized when up and down spins 
divide as evenly as possible (still leaving about half of all 
(^) bonds violated). These numbers for A^ = 9, properly 
rescaled, are plotted in Fig. ^ 

In an attempt to discern a pattern in the growth of 
these numbers, we found a few interesting facts. Starting 
for a given A^ at the FM instance {B — 0), we find 



B < 



N 



(6) 



where \_x\ refers to the next-smallest integer to a;. In 
this regime, the nsiN) instances with B bond violations 
are due to all possible embeddings of B independent — J 
bonds in the fully connected graph of size A^. FM or- 
der is preserved and each new — J bond increments the 
number B of violations. At B — L^/2J , a few embed- 
dings, where all B of such — J bonds are connected to 
the same spin, can be gauge-transformed into instances 
of lower (A even) or equal (A^ odd) number of violations, 
reducing the number of independent instances below the 
prediction Eq. ©. In general, for further increasing B, 
more and more — J bonds can be gauge-transformed away 



3 



at spins where — J bonds equal or outnumber + J bonds. 
A similar behavior is observed starting with the AFM 
instance: initially each +J bond added serves to decre- 
ment the number of violated bonds without changing the 
AFM order. This leads to nB^.^^-i{N) just as given in 
Eq. (jnj, but only for i < [{N — 5)/2j. Instances with 
i = [{N — 3)/2j fewer bond violations than the AFM are 
suddenly far more numerous, consisting not only of those 
with i embedded +J bonds, but also certain instances 
with i + 2 such bonds, in particular (i+2)-gons and -trees. 
While in the AFM state for a given N half of the spins 
are up, the other half down, adding i + 2 ~ [{N + 1)/2J 
connected +J bonds must link oppositely oriented spins, 
which does not help to reduce violated bonds. 

Finding a closed form expression for the number of 
instances with a certain number of bond violations be- 
yond these limits near the FM and the AFM instances 
appears difficult. But we can venture to make some ap- 
proximations to capture the noticeable asymmetry in the 
PDF visible in Fig. As mentioned above, Eq. © 
breaks down for larger numbers of —J bonds because 
instances with any spins having equal or more than half 
their bonds being — J can be gauge transformed and may 
have to be discounted. A conceivable approximation than 
is to only count instances in which no spin has more than 
[{N — 1)/2J of — J bonds, rejecting instances that could 
be gauge-transformed into other instances satisfying this 
condition. This approximation reproduces Eq. ((HJ ex- 
actly, and it predicts exactly that there are no instances 
with more than Bmax violated bonds as given in Eq. 101 . 

Based on these arguments, we now construct an ana- 
lytic expression for nsiN) for iV — > oo. As above, we 
consider embedding a random graph 13j of — J bonds in 
a fully-connected graph otherwise filled with -I- J bonds. 
With the above condition, we assume that in each in- 
stance the number of — J bonds corresponds to the num- 
ber of violations B, which is not generally true. An added 
bond gives each spin a probability of 2/N to be linked 
to it. Then, the probability of a single spin having a 
degree d of - J bonds is pd = (^) (2/A^)''(l - 
Hence, the probability for a single spin to have a degree 
d<dmax= L(^-1)/2J ~ A^/2 is 



Pd<d„ 



d=0 



2Y / 2 



B-a 



(7) 



Naively assuming that each spin can be treated indepen- 
dently, an instance as a whole has a probability oip^^^ 
to be counted. For the total number of instances with B 
violations, we obtain 



n^ 



(8) 



oo with B = 7VV4(1 + 
^ J ' exp{-A^2^2/4| j^-g 

peak. An similar evaluation of Pd<d^i^^ in Eq. Q for 
1 <C < S < A^^/2 yields an internal saddle point [l3| 



Asymptotic analysis for N 
v), V <C 1, shows that 



at d - 2B/N for B < N'^/A where Pd<d^^^ ^ 1 with 
exponentially small corrections, whereas for N'^/A < B < 
N'^/2 the sum in Eq. 10 can be evaluated at its upper 
limit, d^ N/2, to yield 

Pd<d_ - exp{-N/2[AB/N^-l-\n{AB/N^)]}{9) 
- exp{-N/2[v-\n{l + v)]}. (10) 

Note that in the last exponential the linear term in v 
exactly cancels for v <^ 1. In that case, PdKd^^^^ ~ [1 + 
exp(wAf/2)]^^/^ provides an interpolation for both of its 
asymptotic regimes. Then, with v = 2'w/N, we obtain 

nB{N) cx e-"'V(l + e"')"' in Eq. ©. This result is indeed 
independent of N but a very poor (essentially Gaussian) 
fit of the data. 

On the other hand, we may suppose that the cancel- 
lation is accidental, due to the neglect of nontrivial cor- 
relations in the above discussion, and assume that the 
more generic result in Eq. IjlOl) is simple exponential, 
exp(— ckwA^/2) (with some a > 0), leading to an inter- 
polation 



Pd<<imax 1 + exp(ai;A''/2). 
With V = 2w/N, we obtain 

nsiN) cx 



(1 -l-e"'")^' 



(11) 



(12) 



This expression for N ^ oo has a moving saddle 
point 14] at 



Wo 



N\ I N 

In ( a — — In In a — 
2 I 2 



In In (a 



In(af) 



(13) 



listing all orders in the expansion needed to facilitate a 
stationary saddle point. Transforming onto the saddle 
point by substituting w — Wq + x/a into Eq. (|12|) and 
expanding in x ^ wo (i- e. x <C IniV, so the a;-domain 
spans the entire real line for N — > oo), we finally obtain 
Eq. (PJ with an A^-dependent parameter m — -~2wQ/a 
which reduces to Eq. 

Finally, we can use the data in Tab. U also to consider 
the average number of violated bonds in the ground state. 
For each N , this average is a rational number, the denom- 
inator being the total number of instances in the ensem- 
ble. Thus, the numerator provides a sequence of integers 
that is simply related to the average ground state energy. 
Tab, im shows the moments of the energy distribution. To 
retain integer numbers, we define 



£b{N)^2B- 



(14) 



which is related to the true energy of an instance by 
E = £b{N)/VN, according to Eq. JH). Then one would 
expect that \iinN^oo{S{N)) /N^/'^ « -0.7633, the Parisi 
solution for the ground state energy density of the SK 
model 3]. Here, {£{N)) is the ratio of the value in the 
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TABLE II: List of the number of instances / and the first two 
moments (unnormalized) of the distributions listed in Tab.Q] 
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third and the second column in Tab.lTllfor each N . While 
the denominator is simply the number of instances, / = 

2^ 2 i J the value in the third column is highly nontrivial 
with huge prime- factors. Even a partial identification of 
that sequence of numbers seems intractable. 
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